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Abstract — This  paper  presents  a  behavior-based  adaptive  mis¬ 
sion  planner  (AMP)  to  trace  a  chemical  plume  to  its  source  and 
reliably  declare  the  source  location.  The  proposed  AMP  is  im¬ 
plemented  on  a  REMUS  autonomous  underwater  vehicle  (AUV) 
equipped  with  multiple  types  of  sensors  that  measure  chemical 
concentration,  the  flow  velocity  vector,  and  AUV  position,  depth, 
altitude,  attitude,  and  speed.  This  paper  describes  the  methods 
and  results  from  experiments  conducted  in  November  2002  on  San 
Clemente  Island,  CA,  using  a  plume  of  Rhodamine  dye  developed 
in  a  turbulent  fluid  flow  (i.e.,  near-shore  ocean  conditions).  These 
experiments  demonstrated  chemical  plume  tracing  over  100  m 
and  source  declaration  accuracy  relative  to  the  nominal  source 
location  on  the  order  of  tens  of  meters.  The  designed  maneuvers 
are  divided  into  four  behavior  types:  finding  a  plume,  tracing  the 
plume,  reacquiring  the  plume,  and  declaring  the  source  location. 
The  tracing  and  reacquiring  behaviors  are  inspired  by  male  moths 
flying  upwind  along  a  pheromone  plume  to  locate  a  sexually  recep¬ 
tive  female.  All  behaviors  are  formulated  by  perception  and  action 
modules  and  translated  into  chemical  plume-tracing  algorithms 
suitable  for  implementation  on  a  REMUS  AUV.  To  coordinate  the 
different  behaviors,  the  subsumption  architecture  is  adopted  to 
define  and  arbitrate  the  behavior  priorities.  AUVs  capable  of  such 
feats  would  have  applicability  in  searching  for  environmentally  in¬ 
teresting  phenomena,  unexploded  ordnance,  undersea  wreckage, 
and  sources  of  hazardous  chemicals  or  pollutants. 

Index  Terms — Autonomous  underwater  vehicles  (AUVs),  be¬ 
havior-based  planning,  chemical  plume  tracing,  subsumption 
architecture. 


I.  Introduction 

POTENTIAL  application  for  robotics  research  is  an  au¬ 
tonomous  underwater  vehicle  (AUV)  to  search  for  envi¬ 
ronmentally  interesting  phenomena,  unexploded  ordnance,  un¬ 
dersea  wreckage,  and  sources  of  hazardous  chemicals  or  pollu¬ 
tants.  A  key  issue  in  designing  such  an  AUV  system  is  devel- 
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opment  of  an  adaptive  mission  planner  (AMP)  that  is  able  to 
navigate  the  vehicle  in  response  to  real-time  sensor  information 
to  find  the  plume,  trace  the  plume  toward  its  source,  and  declare 
the  source  location.  In  this  paper,  this  problem  will  be  referred 
to  as  chemical  plume  tracing  (CPT). 

Olfactory-based  mechanisms  have  been  hypothesized  for 
a  variety  of  biological  behaviors  [1]— [3]:  homing  by  Pacific 
salmon  [4],  foraging  by  Antarctic  procellariiform  seabirds 
[5],  foraging  by  lobsters  [6],  [7],  foraging  by  blue  crabs  [8], 
and  mate-seeking  and  foraging  by  insects  [9] — [1 1].  Typically, 
olfactory-based  mechanisms  proposed  for  biological  entities 
combine  a  large-scale  orientation  behavior  based  in  part  on 
olfaction  with  a  multisensor  local  search  in  the  vicinity  of  the 
source.  Long-range  search  is  documented  in  Antarctic  procel¬ 
lariiform  seabirds,  possibly  by  olfactory  landmark  navigation 
of  over  1000  km  [5].  Plume  tracing  by  moths  at  ranges  of 
100-1000  m  is  described  in  [10,  p.  276]:  “Rau  and  Rau  (1929) 
provided  perhaps  the  most  extensively  documented  case  of 
long-distance  mate  finding  by  luring  male  silkworm  moths 
released  several  kilometers  from  caged  virgin  females  held  on  a 
second-story  roof  of  their  home  in  St.  Lous,  Missouri  [12].  C.H. 
Femald  also  demonstrated  evident  location  of  distant  females 
in  the  gypsy  moth  ( Lymantria  dispar)  in  New  England:  a  few 
males  released  several  kilometers  away  located  females  after 
several  hours  (Forbush  and  Fernald  1896).”  Unfortunately,  re¬ 
capture  of  released  males  “cannot  disentangle  the  contributions 
of  ranging  flight  which  might  bring  a  male  into  contact  with 
a  pheromone  plume  and  of  pheromone-dictated  maneuvers 
which  close  contact  between  pheromone  sender  and  receiver” 
[10]. 

Factors  that  complicate  CPT  include  the  chemical  source 
concentration  being  unknown,  the  advection  distance  of  any 
detected  chemical  being  unknown,  and  the  flow  variation  with 
both  location  and  time.  Both  engineered  [13]  and  biomimetic 
[14]— [19]  strategies  have  been  evaluated  in  simulation.  Such 
strategies  attempted  to  solve  the  CPT  problem  based  on  fluid 
flow  and  instantaneous  chemical  concentration  measure¬ 
ments  acquired  only  at  the  vehicle  location.  Belanger  and 
Willis  [15],  [16]  presented  plume-tracing  strategies,  including 
counter- turning  strategies,  intended  to  mimic  moth  behavior 
and  analyzed  the  performance  in  a  computer  simulation. 
Grasso  et  al.  [14],  [17],  [18]  evaluated  biomimetic  strategies 
and  challenged  theoretical  assumptions  of  the  strategies  by 
implementing  biomimetic  strategies  on  their  robot  lobster. 
Robots  that  attempt  plume  tracing  in  laboratory  environments 
are  also  described  in  [20]— [23].  The  work  in  [24]— [27]  tested 
some  hypothesized  insect  behaviors  for  plume  tracing  by  using 
mobile  robots  in  laboratories.  For  example,  in  [24],  Grasso 
and  Atema  compared  the  plume-tracing  performance  of  three 
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plume-tracing  strategy  variations  by  using  a  single  sensor  or 
two  sensors  detecting  fluorescence.  Li  et  al.  [19]  developed, 
optimized,  and  evaluated  counter-turning  strategies  inspired  by 
moth  behavior.  Of  all  the  above  work,  none  discussed  the  issue 
of  source  declaration  and  only  [13]  and  [19]  discuss  scales 
significantly  larger  than  a  few  meters.  Whereas  experimental 
studies  described  in  the  existing  literature  have  occurred  in 
structured  laboratory  environments,  only  those  presented  herein 
and  in  [28]  and  [29]  occurred  in  a  complex  fluid  environment 
such  as  the  near-shore  ocean  with  length  scales  of  over  100  m. 

Fundamental  aspects  of  these  research  efforts  include  sensing 
the  chemical,  sensing  or  estimating  the  fluid  velocity,  and  gener¬ 
ating  a  sequence  of  searcher  speed  and  heading  commands  such 
that  the  resulting  AUV  motion  is  likely  to  approach  the  chemical 
source.  In  each  of  the  papers  mentioned  in  the  previous  para¬ 
graph,  the  algorithms  for  generating  speed  and  heading  com¬ 
mands  used  only  instantaneous  (or  very  recent)  sensor  informa¬ 
tion.  Typical  orientation  maneuvers  include:  sprinting  upwind 
upon  detection;  moving  crosswind  when  not  detecting;  and  ma¬ 
nipulating  the  relative  orientation  of  a  multiple  sensor  array,  ei¬ 
ther  to  follow  an  estimated  plume  edge  or  to  maintain  the  max¬ 
imum  mean  reading  near  the  central  sensor. 

An  initial  approach  to  designing  an  AUV  plume-tracing 
strategy  might  attempt  to  calculate  a  concentration  gradient, 
with  subsequent  plume  tracing  based  on  gradient  following.  At 
medium  and  high  Reynolds  numbers,  the  evolution  of  the  chem¬ 
ical  distribution  in  the  flow  is  turbulence  dominated  [3],  [30], 
[31].  The  result  of  the  turbulent  diffusion  process  is  a  highly 
discontinuous  and  intermittent  distribution  of  the  chemical  [9], 
[30]— [35].  A  dense  array  of  sensors  distributed  over  the  area  of 
interest  and  a  long  time  average  of  the  output  of  each  sensor 
(i.e.,  several  minutes  per  sensor)  would  be  required  to  estimate 
a  smooth  (time-averaged)  chemical  distribution.  However, 
the  required  dense  spatial  sampling  and  long  time-averaging 
makes  such  an  approach  ineffective  for  implementation  on  an 
AUV.  In  addition,  even  decameters  from  the  chemical  source 
in  the  direction  of  the  flow  the  gradient  is  too  shallow  to  detect 
in  a  time-averaged  plume.  For  an  “instantaneous”  plume,  the 
gradient  is  time-varying,  steep,  and  frequently  in  the  wrong 
direction,  and  its  evaluation  would  require  numerous  sensors. 
The  essential  issue  that  results  in  gradient  algorithms  being 
ineffective  for  a  single  AUV  in  a  turbulent  flow  environment  is 
that  the  AUV  sampling  is  too  coarse  relative  to  the  spatial  and 
temporal  rates  of  change  that  can  occur  in  the  environment. 

This  paper  systematically  presents  a  novel  approach  to  de¬ 
sign  and  implement  a  complete  AMP  strategy,  including  source 
declaration.  The  strategy  uses  a  subsumption  architecture  with 
certain  behaviors  motivated  by  the  maneuvering  behaviors  of 
moths  flying  upwind  along  a  pheromone  plume.  The  first  step 
in  designing  the  AMP  strategy  is  to  implement  behaviors  for 
finding  the  plume,  tracing  the  plume  toward  its  source,  and  ma¬ 
neuvering  to  accurately  declare  the  source  location.  The  second 
step  is  to  coordinate  the  different  behaviors  using  the  subsump¬ 
tion  architecture.  The  proposed  CPT  strategy  is  different  from 
the  ones  in  [14]-[27]  in  a  variety  of  ways.  First,  this  paper  uses 
a  subsumption  architecture  to  coordinate  the  AMP  behaviors. 
Second,  our  Maintain-Plume  behavior  is  decomposed  into 
Track-In  plume  and  Track-Out  plume  activities,  which  have 


each  been  studied  and  optimized  by  Monte  Carlo  methods  [19]. 
Third,  we  introduce  a  Reacquire-Plume  behavior  that  is  mod¬ 
eled  on  the  idea  of  moth  “casting”  (which  is  discussed  further 
in  the  last  paragraph  of  Section  II),  but  designed  to  be  feasible 
for  implementation  by  an  AUV.  Fourth,  the  CPT  strategy 
is  completed  by  design  and  integration  of  a  Declare-Source 
method.  The  in-water  results  reported  herein  are  the  first  to 
take  CPT  from  the  lab  to  a  complex  real  environment.  While 
the  results  demonstrate  efficient  plume  tracing,  they  also  show 
that  the  efficiency  of  the  Declare-Source  behavior  is  difficult 
to  achieve  and  critical  to  mission  performance.  For  biological 
entities  (e.g.,  moths),  the  conclusion  of  plume  tracing  may 
not  be  based  on  olfaction  alone,  but  could  be  aided  by  vision, 
sight,  auditory,  and/or  tactile  cues.  The  mechanical  structure  of 
the  REMUS  AUV  differs  from  the  structure  of  the  laboratory 
robots  (and  most  biological  entities)  that  were  the  focus  of 
previous  experimental  studies.  Most  laboratory  robots  drive 
their  wheels  differentially  to  control  heading.  Therefore,  they 
can  change  their  orientation  with  a  near  zero  turning  radius. 
In  contrast,  the  REMUS  vehicle  is  fin  controlled.  Therefore,  it 
requires  a  large  (5-10  m)  turning  radius  to  change  orientation. 
This  maneuvering  limitation  had  to  be  addressed  in  the  strategy 
design.  Finally,  source  declaration  on  an  AUV  must  address 
practical  issues  such  as  the  time-varying  position  estimation 
error.  The  experiments  described  in  this  paper  utilize  a  new 
source-declaration  algorithm  that  worked  reliably,  but  was 
relatively  slow.  This  paper  presents  a  complete  CPT  strategy, 
a  thorough  analysis  of  successful,  large-scale,  in-water  exper¬ 
imental  data  acquired  at  San  Clemente  Island  in  November 
2002,  and  suggestions  for  future  improvements. 

The  assumptions  made  herein  relative  to  the  chemical  and 
flow  are  that  the  chemical  is  a  neutrally  buoyant  and  passive 
scalar  advected  by  a  turbulent  flow.  The  REMUS  AUV  is  ca¬ 
pable  of  sensing  position,  chemical  concentration,  and  flow  ve¬ 
locity.  In  the  proposed  strategy,  the  concentration  sensor  works 
as  a  “binary  detector.”  The  binary  detector  provides  at  9  Hz  a 
Boolean  value  indicating  the  presence  of  chemical.  The  Boolean 
value  is  “1”  if  the  chemical  concentration  is  above  the  threshold, 
while  the  Boolean  value  is  “0”  if  the  chemical  concentration  is 
below  the  threshold.  Boolean  sensing  is  also  used  in,  e.g.,  [13], 
[15],  [16],  [19],  and  [23].  Boolean  sensing  combined  with  dif¬ 
ferential  sensing  across  two  antennae  is  considered  in  [17].  The 
strategy  presented  herein  is  implemented  to  solve  the  plume¬ 
tracing  problem  in  two  dimensions.  A  main  motivation  for  im¬ 
plementing  the  algorithms  in  two  dimensions  is  the  computa¬ 
tional  simplification  achieved;  however,  neutral  buoyancy  of  the 
chemical  [36]  or  stratification  of  the  flow  [37]  will  often  result 
in  a  plume  of  limited  vertical  extent,  which  may  be  approxi¬ 
mated  as  a  two-dimensional  (2-D)  problem.  To  take  advantage 
of  these  features,  the  AUV  will  operate  in  a  fixed-altitude  ter¬ 
rain-following  mode  intended  to  keep  the  vehicle  in  the  bottom 
boundary  layer. 

This  paper  is  organized  as  follows.  In  Section  II,  we  discuss 
various  aspects  of  the  CPT  mission.  In  Section  III,  we  present 
the  subsumption  architecture  for  the  AMP.  In  Section  IV,  we 
formulate  the  behaviors  and  translate  them  into  algorithms.  In 
Section  V,  we  analyze  the  results  from  in-water  experiments 
conducted  at  San  Clemente  Island  in  November  2002.  In  Sec- 
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Fig.  1 .  Ideal  plume  tracing  in  the  planning  coordinate  system.  The  solid  black  line  indicates  the  actual  AUV  trajectory  including  preplanned  (Mission  A)  and 
reactively  planned  (Mission  B)  portions.  The  circle  indicates  the  chemical  source.  The  flow  is  drawn  positive  to  the  right.  The  shaded  cone  emanating  from  the 
source  depicts  a  highly  simplified  chemical  plume. 


tion  VI,  we  draw  some  conclusions  about  the  AMP  strategy  and 
experimental  results. 

II.  Mission  Profile 

The  goal  of  the  CPT  AUV  is  to  locate  the  source  of  a  chem¬ 
ical  that  is  transported  in  a  turbulent  fluid  flow.  We  assume  that 
the  AUV  is  constrained  to  maneuver  within  a  rectangular  re¬ 
gion  referred  to  as  the  operation  area  (OpArea)  that  is  speci¬ 
fied  by  the  test  director  prior  to  the  start  of  the  mission.  The 
OpArea  is  defined  by  the  geodetic  latitude  and  longitude  coor¬ 
dinates  of  the  comers  of  the  rectangle.  Latitude  and  longitude 
are  also  used  for  reporting  important  locations.  Specific  infor¬ 
mation  about  the  experimental  OpArea  is  given  in  Section  V.  In 
addition  to  geodetic  coordinates,  the  AMP  maintains  two  other 
sets  of  coordinates  for  convenience  of  planning  and  data  presen¬ 
tation.  The  North-East  (N,  E)  coordinate  system  has  axes  aligned 
with  latitude  and  longitude,  respectively,  but  with  coordinates 
measured  in  meters  and  the  origin  of  the  coordinate  system  at 
the  center  of  the  OpArea.  The  planning  space  coordinates  are 
denoted  (x,  y).  The  x  axis  is  aligned  with  the  long  axis  of  the 
rectangular  OpArea.  When  drawn  in  the  plane  of  the  page,  as 
in  Figs.  1  and  3,  the  x  axis  is  drawn  positive  to  the  right.  The  y 
axis  is  drawn  as  positive  downward.  The  (N,  E)  coordinates  are 
related  to  the  (x,  y)  coordinates  through  a  simple  rotation  about 
the  local  vertical  axis.  The  heading  0  is  defined  as  positive  in 
the  clockwise  direction.  Typically,  the  OpArea  is  defined  with 
its  longer  axes  approximately  parallel  to  the  shoreline.  Also,  the 
flow  is  typically  dominant  in  the  direction  parallel  to  the  shore¬ 
line.  Therefore,  in  planning  space  coordinates,  the  direction  of 
the  (mean)  flow  will  often  be  within  45°  of  the  x  axis.  This  in¬ 
formation  is  not  used  by  the  planner,  but  is  convenient  for  data 
presentation. 


Fig.  1  shows  a  hypothetical  plume-tracing  trajectory  in  the 
planning  coordinate  system.  The  trajectory  indicates  two  mis¬ 
sion  components  labeled  as  Mission  A  and  Mission  B.  Mission 
A  is  a  preplanned  (offline)  trajectory  controlled  by  the  original 
mission  planner  developed  by  Woods  Hole  Oceanographic  In¬ 
stitute  (WHOI).  Fig.  1  shows  the  entire  Mission  A  as  a  light 
dashed  line;  however,  the  AUV  only  performs  the  portion  that 
is  indicated  by  the  wide  solid  line.  Mission  B  is  implemented 
and  managed  online  by  the  AMP  to  achieve  plume  tracing  and 
chemical  source  declaration  by  reacting  in  real-time  to  chemical 
detection  and  flow  information.  In  our  experiments,  Mission  A 
will  be  used  to  drive  REMUS  to  a  desired  starting  point  in  the 
OpArea.  At  that  location,  Mission  B  activates,  performs  its  CPT 
tasks  and  then  deactives  to  allow  Mission  A  to  drive  the  AUV  to 
a  rendezvous  location  for  pickup.  For  vehicle  security,  Mission 
A  would  also  take  over  if  the  AUV  moved  sufficiently  far  (i.e., 
30  m)  outside  the  specified  OpArea.  This  did  not  occur  in  the 
set  of  experiments  described  herein. 

During  Mission  B,  the  AUV  will  search  for  a  specific  chem¬ 
ical  within  the  OpArea.  If  the  chemical  is  detected,  the  vehicle 
should  trace  the  chemical  plume  to  its  source  and  accurately  de¬ 
clare  the  source  location.  For  plume-tracing  tasks,  the  location 
of  pheromone-emitting  females  by  flying  male  moths  is  con¬ 
sidered  to  be  a  remarkable  case  of  chemical-guided  navigation. 
The  AMP  strategy  described  herein  is  inspired  by  biological 
behaviors  hypothesized  from  observations  of  moths  [9] — [1 1], 
[15],  [16].  These  hypothesized  behaviors  can  be  summarized  as 
follows.  When  a  moth  detects  pheromone,  it  tries  to  maintain 
contact  with  the  plume  and  to  move  upwind  toward  the  source 
location.  The  maneuver  is  exhibited  as  a  short  sprint  predom¬ 
inantly  in  the  upwind  direction.  Repeated  pheromone  encoun¬ 
ters  result  in  the  moth  progressively  approaching  the  chemical 
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Fig.  2.  Subsumption  architecture  for  the  CPT  AMP. 


source.  When  a  moth  has  not  detected  pheromone  for  a  suf¬ 
ficiently  long  period  of  time,  it  ceases  upwind  movement  and 
performs  progressively  widening  crosswind  excursions,  termed 
“casting.”  In  this  case,  the  moth  appears  to  be  searching  for 
pheromone  near  the  position  where  it  was  last  detected.  This 
reacquiring  behavior  can  continue  for  several  seconds  until  ei¬ 
ther  chemical  is  again  detected  or  the  moth  behavior  changes. 
If  the  moth  fails  to  detect  pheromone  again,  it  may  return  to  the 
Finding-Plume  behavior  used  initially  for  location  of  the  plume. 
The  moth  approach  to  finding  the  plume  has  been  studied  in  the 
field,  e.g.,  [11],  [38],  but  still  is  not  well  understood  due  to  dif¬ 
ficulties  related  to  tracking  the  moths  over  long  distances  and  to 
knowing  when  an  in-flight  moth  is  detecting  pheromone. 

III.  Subsumption  Architecture 

Our  approach  uses  a  behavioral  control  approach  [39] — [45], 
with  the  behaviors  being  coordinated  in  a  subsumption  architec¬ 
ture  [41].  For  CPT,  we  use  four  behaviors:  Find-Plume,  Main- 
tain-Plume,  Reacquire-Plume,  and  Declare-Source.  In  this  set  of 
behaviors,  Maintain-Plume  and  Reacquire-Plume  are  moth  in¬ 
spired.  The  Find-Plume  and  Declare-Source  behaviors  are  en¬ 
gineering-based.  The  CPT  AMP  subsumption  architecture  is 
shown  in  Fig.  2.  The  control  commands  from  the  planner  to  the 
vehicle  guidance  and  control  functions  are  speed  and  heading 
commands.  The  inhibition  approach  is  used  to  arbitrate  between 
the  commands  from  the  various  behaviors  to  determine  the  com¬ 
manded  output  of  the  AMP.  In  Fig.  2,  the  circles  labeled  with 
an  “S”  are  subsumption  modules.  The  output  of  the  subsump¬ 
tion  module  is  connected  to  the  top  input  of  another  subsump¬ 
tion  module.  If  the  top  input  to  the  subsumption  module  has  any 
value,  then  the  output  of  the  subsumption  module  assumes  that 
value;  otherwise,  the  output  of  the  subsumption  module  takes 


the  value  of  its  left  input.  The  following  text  discusses  the  priori¬ 
ties  imposed  by  the  subsumption  architecture  in  Fig.  2  with  brief 
descriptions  of  the  behaviors.  A  detailed  description  of  each  be¬ 
havior  in  Fig.  2  is  provided  in  Section  IV. 

For  the  AMP  CPT  strategy,  the  declare-source  behavior  has 
the  highest  priority.  Once  that  behavior  has  declared  the  source 
location,  it  defines  its  commanded  outputs  to  drive  the  vehicle  to 
a  home  location.  The  declare-source  output  commands  block  the 
commands  from  any  other  behaviors.  The  maintain-plume  be¬ 
havior  includes  track-in  and  track-out  activities.  Track-in  tries  to 
make  rapid  progress  toward  the  source  while  chemical  is  being 
detected.  Track-out  manipulates  the  AUV  heading  relative  to 
upflow  in  the  time  immediately  following  the  loss  of  chemical 
detection  to  try  to  rapidly  recontact  the  plume.  These  activities 
have  the  second  and  third  highest  priorities.  For  these  activities 
to  be  controlling  the  vehicle,  the  AUV  will  either  be  detecting  or 
have  recently  been  detecting  an  above  threshold  concentration 
of  chemical.  To  ensure  that  maneuvers  to  maintain  contact  with 
the  plume  occur  in  an  uninterrupted  fashion,  maintain-plume  be¬ 
haviors  block  the  commands  from  any  other  behaviors  except 
for  those  following  source  declaration. 

The  move-to-field  behavior  has  the  lowest  priority.  This  be¬ 
havior  is  only  used  to  send  the  vehicle  to  a  desired  location  in 
the  OpArea  at  the  beginning  of  the  mission.  The  output  com¬ 
mands  from  this  behavior  are  blocked  once  the  vehicle  acti¬ 
vates  any  other  behaviors.  The  find-plume  behavior  issues  com¬ 
mands  designed  to  explore  the  entire  OpArea.  The  resulting  tra¬ 
jectories  are  similar  to  a  ball  bouncing  on  a  billiard  table.  The 
find-plume  behavior  will  continue  until  either  a  timeout  condi¬ 
tion  is  achieved  or  a  chemical  detection  event  causes  another  be¬ 
havior  to  become  active.  The  priority  of  the  reacquire-plume  be¬ 
havior  is  above  that  of  the  find-plume  behavior.  If  the  track-out 
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activity  fails  to  detect  chemical  within  a  given  time  period,  then 
the  maintain-plume  behavior  deactivates.  In  this  case,  the  reac- 
quire-plume  behavior  will  maneuver  the  AUV  in  the  vicinity  of 
the  most  recent  chemical  detection  location.  This  is  similar  to 
moth  casting.  The  hope  is  that  the  local  area  search  directed  by 
the  reacquire-plume  behavior  will  recontact  the  plume.  If  it  does 
not,  then  its  deactivation  causes  the  find-plume  behavior  to  take 
over.  The  find-plume  behavior  may  be  time  consuming  since  it 
will  potentially  search  the  entire  Op  Area  to  detect  chemical. 

IV.  Formulation  of  Behaviors 

The  next  important  step  is  to  design  an  algorithm  that  will 
generate  a  feasible  AUV  trajectory  to  reliably  achieve  the  goal 
of  each  behavior.  Based  on  schema  theory  [42],  the  behaviors  of 
the  REMUS  vehicle  are  decomposed  into  perception  and  action 
modules.  Schema  theory  is  well  suited  for  transferring  theoret¬ 
ical  concepts  into  the  object-oriented  programming  constructs 
used  to  implement  the  behaviors. 

The  perception  module  is  identical  for  all  behaviors.  The 
REMUS  computer  sends  messages  containing  the  sampled 
chemical  concentration  a  and  vehicle  state  to  the  AMP  at  9  Hz 
and  acoustic  Doppler  data  at  0.5  Hz.  The  planning  cycle  for 
generating  the  heading  and  speed  commands  is  1  Hz.  For  the 
AMP  planning  cycle,  the  perception  module  calculates  the 
maximum  value  from  the  nine  most  recent  chemical  concen¬ 
tration  samples  and  uses  the  most  recent  vehicle  state.  The 
perception  module  processes  the  vehicle  velocity  and  acoustic 
Doppler  data  to  estimate  the  flow  velocity  of  the  fluid  relative 
to  the  earth.  Since  this  estimated  flow  velocity  is  very  noisy, 
the  flow  used  by  the  AMP  is  averaged  over  100  s.  The  outputs 
from  each  of  the  action  modules  are  the  commands  for  the 
vehicle  speed  v  and  heading  0.  Prior  to  each  run,  the  speed 
command  is  set  as  a  constant  value  by  the  test  director.  The 
tradeoffs  related  to  the  choice  of  the  commanded  speed  are  that 
increasing  the  speed  searches  the  region  faster,  but  also  results 
in  fewer  concentration  measurements  per  meter  traveled  since 
the  sample  rate  is  fixed. 

A.  Find-Plume  Behavior 

The  problem  of  determining  the  optimal  direction  to  search 
for  a  chemical  plume  in  a  time- varying  flow  is  addressed  theo¬ 
retically  in  [46]  and  [47].  When  the  flow  is  slowly  time-varying 
relative  to  the  rate  that  the  searcher  can  explore,  those  results 
show  that  a  cross-flow  search  provides  more  information  than  an 
along-flow  search.  Since  the  mission  time  can  be  scheduled  and 
a  slowly  time- varying  flow  generates  a  well-defined  plume  that 
facilitates  plume  tracing,  the  mission  times  are  selected  during 
periods  when  the  flow  is  slowly  time  varying.  Using  these  facts, 
the  find-plume  behavior  was  designed  to  dominantly  implement 
a  cross-flow  search.  The  behavior  also  implements  a  smaller 
along-flow  component  to  ensure  that  the  entire  search  region 
will  ultimately  be  explored. 

Definition:  The  find-plume  behavior  is  designed  without  any 
assumptions  about  the  location  of  the  source  within  the  Op  Area. 
The  behavior  does  incorporate  the  fact  that  when  there  is  a 
source  in  the  OpArea,  the  AUV  will  be  more  likely  to  detect 
chemical  along  a  downflow  edge  than  along  an  upflow  edge.  The 


Fig.  3.  An  idealized  trajectory  for  the  find-plume  behavior. 


find-plume  behavior  could  initiate  in  two  situations.  The  first  sit¬ 
uation  is  at  the  start  of  the  mission  prior  to  any  chemical  being 
detected.  The  second  situation  is  after  the  track-in,  track-out, 
and  reacquire  behaviors  have  each  turned  off  due  to  a  lack  of  re¬ 
cent  chemical  detections.  The  main  features  of  this  behavior  are 
the  AUV  should  move  predominantly  across  the  flow,  the  trajec¬ 
tory  should  contain  an  along  the  flow  component  to  cause  the  ve¬ 
hicle  to  explore  new  territory  within  the  OpArea,  and,  when  the 
upflow  boundary  is  eventually  encountered,  the  vehicle  should 
rapidly  move  to  the  downflow  edge  of  the  OpArea.  The  com¬ 
manded  heading  is  defined  as  6  =  flow_dir  +  sign(?7)  *  d9, 
which  is  an  offset  to  the  computed  flow  direction  denoted  by 
“flow_dir.”  The  sign  of  the  variable  r]  will  be  either  d=l.  The 
variable  d0  can  only  take  on  one  of  the  two  constant  values  d#up 
and  d#down-  A  typical  AUV  trajectory  is  depicted  in  Fig.  3.  A 
logic  flow  diagram  for  the  algorithm  is  shown  in  Fig.  4  and  is 
discussed  below. 

Each  time  that  the  CPT  algorithm  initiates  the  find-plume  be¬ 
havior,  the  initial  commanded  vehicle  direction  is  determined 
as  follows.  The  initial  vehicle  position  ( xq ,  yo )  divides  the  plan¬ 
ning  space  into  four  subareas,  as  illustrated  in  Fig.  3.  With  a  uni¬ 
form  distribution  of  probable  source  locations,  the  largest  sub- 
area  is  most  likely  to  contain  the  source.  Therefore,  the  initial 
values  of  the  parameters  77  and  d 0  are  defined  so  that  the  AUV 
will  drive  into  the  largest  of  the  four  subareas.  If,  at  any  time, 
the  sensed  concentration  a  is  above  the  detection  threshold,  then 
track-in  will  activate,  which  will  inhibit  the  find-plume  com¬ 
mands.  As  long  as  a  is  below  threshold,  the  AUV  will  continue 
to  maneuver  for  plume  finding. 

While  the  vehicle  maneuvers,  the  find-plume  behavior  checks 
if  the  AUV  is  in  the  OpArea.  While  in  the  OpArea,  the  flow 
relative  offset  is  constant  since  77  and  dO  are  constant.  When 
the  AUV  reaches  an  OpArea  boundary,  then  either  the  value 
of  77  or  d6  will  change.  If  the  AUV  reaches  Xmin  (i.e.,  the  left 
boundary  of  planning  space),  then  the  down-flow  search  offset 
angle  d#down  is  used.  If  the  AUV  system  reaches  Xmax  (i.e., 
the  right  boundary  of  planning  space),  then  the  up-flow  search 
offset  angle  dOup  is  used. 
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Fig.  4.  Logic  diagram  for  the  find-plume  behavior.  The  current  vehicle  lo¬ 
cation  in  planning  coordinates  is  (x,y).  The  planning  space  Op  Area  is  a  rec¬ 
tangle  aligned  with  the  axes  with  lower  left  comer  at  (Xmin,  Ymax)  and  upper 
right  comer  at  (Xmax,  Ymin).  The  sense  chemical  concentration  is  a.  The  com¬ 
manded  heading  and  speed  are  9  and  v. 

The  variable  y  defined  as  77  =  0.5(l^nin  +  Y^ax)  —  y  points 
from  the  vehicle  location  toward  the  x  axis.  The  value  of  77  is  re¬ 
computed  only  when  the  AUV  leaves  the  OpArea  through  either 
its  upper  or  lower  boundaries  in  planning  space  (i.e.,  y  <  Y^in 
or  y  >  Yinax)-  The  sign  function 

signW  =  {-l|  J<0° 

results  in  a  commanded  value  of  the  heading  such  that  the  ve¬ 
hicle  returns  to  the  OpArea  and  drives  toward  the  opposite  y 
boundary  of  the  OpArea. 

When  the  OpArea  is  large  and  there  is  no  prior  information 
about  the  source  location  (i.e.,  uninformed  search),  the  find- 
plume  behavior  may  consume  a  significant  amount  of  time  to 
find  the  plume.  Therefore,  once  the  chemical  plume  is  detected, 
the  other  behaviors  are  designed  to  maintain  at  least  intermittent 
contact  with  the  plume,  to  decrease  the  likelihood  that  the  AMP 
returns  to  the  find-plume  behavior. 

Since  the  OpArea  is  defined  by  the  test  director,  the  find- 
plume  behavior  has  only  two  adjustable  parameters:  dOup  and 
d^down-  As  a  result  of  Monte  Carlo  simulation  studies  described 
in  [19]  the  up-flow  and  down-flow  search  offsets  were  selected 
as  dOup  =  125°  and  dO down  =  60°. 

B.  Maintain-Plume  Behavior:  Track-In  and  Track-Out 

This  section  defines  the  track-in  and  track-out  activities  of  the 
maintain-plume  behavior.  This  behavior  was  inspired  by  those 
hypothesized  for  male  moths  based  on  experimental  observa¬ 
tions:  when  a  male  moth  detects  pheromone,  it  modulates  its 
steering,  speed,  and  counter-tuning  frequency  to  maintain  in¬ 
termittent  contract  with  the  plume  while  achieving  movement 
toward  the  source  location.  Similarly,  once  chemical  has  been 


detected,  the  purpose  of  the  maintain-plume  activities  is  to  keep 
the  AUV  in  the  plume  while  making  progress  toward  its  source. 

The  phrase  “in  the  plume”  requires  clarification  as  different 
researchers  define  it  differently.  Because  the  plume  is  composed 
of  filaments  of  chemical  transported  by  a  turbulent  fluid  flow,  it 
is  possible  for  the  sensor  to  be  between  filaments  without  de¬ 
tecting  chemical;  therefore,  the  sensed  chemical  concentration 
is  an  intermittent  signal.  The  fluid  dynamics  literature  contains 
definitions  of  plume  length  scales  based  on  the  distances  over 
which  signals  are  correlated  (see,  e.g.,  [48]  and  [49]  for  a  dis¬ 
cussion  of  length  scales  relative  to  biological  chemical  sensing). 
Such  definitions  are  useful  for  theoretical  discussions,  but  im¬ 
practical  for  behavior  design.  For  this  paper,  we  will  say  that  the 
AUV  is  “in  the  plume”  at  time  t  if  the  sensed  chemical  concen¬ 
tration  has  been  above  threshold  at  least  once  in  the  previous  A 
seconds.  The  AUV  is  not  “in  the  plume”  at  time  t  if  the  sensed 
chemical  concentration  has  not  been  above  threshold  within  the 
last  A  seconds.  Note  that  in  this  definition,  the  AUV  being  in  the 
plume  at  time  t  does  not  require  the  sensed  chemical  concentra¬ 
tion  to  be  above  threshold  at  time  t.  Note  also  that  if  the  AUV 
has  recently  detected  chemical,  then  it  is  likely  to  be  in  or  near 
the  plume.  As  the  time  since  the  last  detection  increases,  then  it 
is  increasingly  likely  that  the  vehicle  is  out  of  the  plume. 

Definition:  To  maintain  contact  with  the  plume  at  least  inter¬ 
mittently,  the  maintain-plume  behavior  may  use  two  activities: 
track-in  and  track-out.  Fig.  5  will  be  useful  to  describing  these 
activities.  The  logic  flow  diagram  for  the  maintain-plume  be¬ 
havior  is  shown  in  Fig.  6.  In  Fig.  5,  the  gray  patches  represent 
chemical  filaments.  In  relation  to  Fig.  5,  we  assume  that  chem¬ 
ical  is  detected  when  the  trajectory  is  within  a  filament.  The  se¬ 
quence  of  thin  solid  arrows  that  are  connected  head-to-tail  in¬ 
dicates  the  AUV  chemical  sensor  trajectory.  The  three  wider 
solid  arrows  indicate  the  local  flow  direction  at  the  time  the 
sensor  was  at  the  corresponding  location.  The  black  dots  indi¬ 
cate  times  at  which  a  behavior  change  occurs.  When  the  sensed 
chemical  concentration  is  above  threshold,  then  the  track- in  ac¬ 
tivity  becomes  active,  for  example,  ATi  and  AT3  in  Fig.  5.  If 
the  sensed  chemical  is  below  threshold,  but  was  above  threshold 
within  the  last  A  seconds,  then  the  track-out  action  is  active, 
for  example,  AT2  and  AT4  in  Fig.  5.  If  the  AUV  does  not  de¬ 
tect  above-threshold  concentration  during  the  previous  A  sec¬ 
onds,  then  the  maintain-plume  behavior  turns  off,  which  causes 
the  Reacquire  behavior  to  become  active,  for  example  at  t  = 
Tiast  +  A  as  shown  in  Fig.  5. 

The  Monte  Carlo  simulation  analysis  described  in  [19] 
studied  various  maintain-time  strategies  and  various  choices 
of  design  parameters  for  each  strategy.  The  main  performance 
measures  were  robustness  to  environmental  factors,  ability  to 
maintain  plume  contact,  and  ability  to  make  progress  toward 
the  source.  A  major  result  of  that  study  was  that  counter-turning 
strategies  led  to  significant  increases  in  performance.  Upon 
losing  contact  with  the  plume,  such  strategies  intentionally  turn 
in  a  direction  that  is  considered  most  likely  to  contain  the  plume. 
The  strategy  of  Fig.  6  implements  one  of  the  counter- turning 
strategies. 

The  maintain-plume  behavior  activates  when  the  AUV 
detects  above  threshold  chemical  concentration.  The  track-in 
action  activates  first.  The  track-in  activity  steers  the  AUV  to 


298 


IEEE  TRANSACTIONS  ON  ROBOTICS,  VOL.  22,  NO.  2,  APRIL  2006 


Track- In  Plume 


Fig.  5.  Track-in  and  track-out  actions  in  the  maintain-plume  behavior. 


Fig.  6.  Logic  diagram  for  the  maintain-plume  behavior.  The  track-in  action  is 
defined  by  the  left  path.  The  track-out  action  is  defined  by  the  right  two  paths. 
The  variables  (£iast?  2/iast)  are  saved  for  possible  later  use  by  the  reacquire- 
plume  behavior. 


move  directly  up-flow.  Near  the  source,  where  the  plume  axis 
is  aligned  with  the  flow,  this  will  result  in  rapid  progress  toward 
the  source.  Further  from  the  source,  where  the  plume  axis  and 
local  flow  may  not  align,  the  AUV  is  likely  to  exit  the  plume 
prior  to  reaching  the  source. 

When  the  sensed  concentration  drops  below  threshold,  the 
track-out  activity  adds  an  offset  [3  from  the  upflow  direction 


to  the  commanded  heading.  The  offset  (3  and  the  commanded 
heading  6  are  computed  as 

<t>  =  atan2  ((yiast  -  y),  (^last  -  x)) 

A(j)  =  flow  _dir  —  <j> 
f3  =  10sign(A</>) 

0  =  flow  _dir  +  180  -1-  (3 

where  (#iast52/iast)  is  the  last  location  at  which  chemical  was 
detected,  </>  defines  the  direction  of  the  vector  from  the  current 
AUV  location  to  the  last  detection  point,  and  A(f>  is  the  error 
between  the  flow  direction  and  </>.  Assuming  that  the  vehicle 
yaw  is  currently  within  90°  of  upflow  (as  it  should  be  during 
track-in),  the  sign  of  A<j)  indicates  the  direction  relative  to  up¬ 
flow  (right  =  1  or  left  =  —  1)  that  is  more  likely  to  contain  the 
plume.  The  magnitude  of  the  offset  relative  to  upflow  is  selected 
to  be  10°  based  on  the  analysis  in  [19]  and  simulations  using 
a  relatively  accurate  vehicle  dynamic  model.  The  track-out  ac¬ 
tivity  continues  until  either  chemical  is  again  detected  or  the 
time  since  the  last  detection  exceeds  A  seconds. 

The  only  two  tunable  parameters  in  the  maintain-plume 
strategy  are  A  and  the  magnitude  of  f3.  The  effects  on  perfor¬ 
mance  of  changing  each  parameter  were  studied  in  [19].  Based 
on  those  studies  and  issues  related  to  vehicle  maneuverability, 
A  was  selected  as  8.5  s. 

C.  Reacquire-Plume  Behavior 

Biological  studies  such  as  [50]  and  [51]  report  that  male 
moths  cast  when  they  appear  to  lose  contact  with  the  pheromone 
plume.  Casting  implies  that  the  moth  ceases  upwind  movement 
and  performs  progressively  widening  cross  wind  excursions. 
Such  casting  behavior  results  in  a  local  search  for  the  plume  in 
the  vicinity  of  the  position  where  plume  contact  was  lost. 
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Fig.  7.  Clover-leaf  trajectory  for  the  reacquire-plume  behavior.  The  orientation 
of  the  trajectory  in  this  figure  assumes  that  the  flow  is  from  left  to  right.  The 
maneuver  is  centered  on  the  last  detection  point. 

Definition:  The  objective  of  the  reacquire-plume  behavior  is 
to  reacquire  contact  with  the  plume  in  the  situation  where  chem¬ 
ical  has  not  been  detected  for  at  least  A  seconds.  The  behavior 
was  inspired  by  those  hypothesized  for  moths,  but  also  con¬ 
strained  by  vehicle  maneuverability  issues.  When  the  reacquire- 
plume  behavior  initiates,  chemical  has  been  previously  detected 
approximately  A  seconds  ago  at  location  (#iast?2/iast)-  There¬ 
fore,  similar  to  moth  casting  behavior,  the  reacquire-plume  be¬ 
havior  will  cause  the  AUV  to  perform  maneuvers  across  the  flow 
in  the  vicinity  of  the  location  (#iast,2/iast)- 

There  are  a  few  principal  reasons  that  upflow  motion  within 
the  plume  might  lead  to  loss  of  contact  with  the  plume  [52]. 
First,  the  internal  structure  of  plumes  is  patchy,  that  is,  in  certain 
locations,  the  signal  is  not  present  or  it  is  below  the  threshold  of 
detection.  Due  to  this  patchiness,  the  vehicle-mounted  sensor 
may  pass  between  chemical  filaments  without  detecting  any 
chemical  even  though  the  AUV  is  in  the  plume.  This  is  the 
reason  for  using  a  nonzero  value  of  A.  Second,  the  upflow  mo¬ 
tion  may  lead  out  of  the  plume  since  meander  of  the  plume 
centerline  can  cause  the  plume  centerline  to  not  be  parallel  to 
the  local  flow  direction.  Third,  when  the  vehicle  approaches  the 
plume  source,  continued  upflow  motion  will  cause  it  to  pass  the 
source.  It  is  important  to  consider  all  three  of  these  cases  while 
designing  the  reacquire-plume  behavior  module. 

The  cloverleaf  trajectory  that  we  selected  is  illustrated  in 
Fig.  7,  where  the  assumed  flow  direction  is  from  the  left  to  the 
right.  The  center  of  the  cloverleaf  maneuver  is  (#iast?  2/last  )• 
The  length  of  each  leaf  is  defined  by  the  parameter  d\^ f.  The 
minimum  value  of  c?ieaf  is  constrained  to  be  larger  than  the 
AUV  turning  radius.  Leaves  1  and  2  (upper  left  and  lower  left) 
provide  significant  crossflow  excursions  that  are  designed  to 
contact  the  plume  in  meander  situations.  Based  on  the  sign 
of  /3,  the  AMP  can  estimate  on  which  side  of  the  plume  the 
vehicle  is  located  and  select  the  most  appropriate  of  leaves  1  or 
2  to  execute  first.  Leaf  3  is  aligned  with  the  plume  centerline  in 
the  down-flow  direction.  This  leaf  is  very  important  when  the 
vehicle  has  passed  the  chemical  source  location.  This  clover¬ 
leaf  pattern  is  selected  as  it  yields  a  significant  search  in  all 
directions  relative  to  the  last  detection  point  and  it  is  achievable 
within  the  vehicle  maneuvering  constraints. 

The  logic  flow  diagram  in  Fig.  8  describes  the  implementa¬ 
tion  of  the  reacquire-plume  behavior.  This  behavior  will  stay 
active  until  either  chemical  is  detected  or  the  AUV  completes 


Fig.  8.  Diagram  for  reacquire-plume  behavior  action. 


the  cloverleaf  trajectory  Nre  times.  If  chemical  is  detected, 
the  maintain-plume  behavior  will  activate  and  inhibit  the 
reacquire-plume  behavior.  If  Nre  repetitions  are  completed 
without  a  chemical  detection,  then  this  behavior  deactivates, 
which  causes  find-plume  to  become  the  active  behavior.  While 
reacquire-plume  is  active  the  function  cloverleaf  is  used  to 
issue  the  heading  commands  required  for  the  vehicle  to  follow 
the  cloverleaf-shaped  trajectory. 

The  only  free  parameters  in  the  design  of  this  behavior  are 
Nre  and  c?ieaf  •  The  cloverleaf  pattern  is  repeated  to  decrease  the 
probability  that  the  vehicle  passes  through  the  gaps  in  the  plume 
and  reverts  to  the  find-plume  behavior  when  it  is  near  the  source. 
The  tradeoff  is  that  the  AUV  could  spend  too  much  search  time 
near  the  location  of  a  spurious  detection.  In  our  experiments, 
Nre  is  3  and  d\ea£  is  between  10-15  m. 

D.  Declare-Source  Behavior 

There  is  no  clear  analog  to  the  AUV  declare-source  behavior 
for  male  moths.  The  male  moth  does  not  maneuver  in  the 
vicinity  of  the  female  moth  based  on  scent  alone  and  then 
return  home  to  broadcast  her  location.  Instead,  while  the  moth 
plume  tracing  relies  primarily  on  sensed  pheromone,  the  final 
determination  as  to  the  location  of  the  female  moth  could  be 
based  on  data  from  multiple  sensors,  which  may  include  vision, 
tactile,  or  even  auditory  cues.  However,  for  CPT  using  AUVs, 
the  present  state  of  technology  requires  that  we  determine 
the  chemical  source  location  based  only  on  the  locations  of 
chemical  detection  events.  Fortunately,  we  can  design  AUV 
maneuvers  to  increase  the  accuracy  of  the  declared  source 
location.  Therefore,  the  methodology  of  the  declare-source  be¬ 
havior  is  more  engineering-oriented  than  biologically  inspired. 
We  designed  the  source  declaration  logic  based  on  analysis, 
Monte  Carlo  simulation,  and  results  of  initial  field  experiments. 

Definition:  The  objective  of  the  declare-source  behavior 
is  to  estimate  and  declare  the  chemical  source  location.  The 
declaration  must  be  accurate  and  reliable  in  the  sense  that  it 


300 


IEEE  TRANSACTIONS  ON  ROBOTICS,  VOL.  22,  NO.  2,  APRIL  2006 


makes  no  false  declarations.  This  behavior  contains  a  percep¬ 
tional  module,  for  estimating  the  source  location,  and  an  action 
module,  for  first  moving  to  the  source  location  after  it  has  been 
estimated  and  then  driving  the  vehicle  to  the  home  location. 

Due  to  the  design  of  the  maintain  and  reacquire  behaviors,  as 
verified  in  Monte  Carlo  simulation  and  in-water  studies,  when 
the  AUV  is  far  from  the  source,  the  locations  at  which  the  AUV 
loses  contact  with  the  plume  will  be  widely  separated  along 
the  axis  of  the  plume.  When  the  AUV  traces  the  plume  to  the 
source  location,  it  will  exit  the  plume  and  move  up  flow  from  the 
source.  In  this  case,  the  vehicle  activates  the  reacquire-plume 
behavior.  The  AUV  will  usually  recontact  the  plume  on  leaf 
3  of  the  clover  leaf  trajectory  since  leaves  1  and  2  are  upflow 
from  the  last  detection  point.  No  matter  which  leaf  generates  the 
next  detection,  the  maintain-plume  behaviors  will  activate,  and 
this  sequence  of  behaviors  will  repeat.  We  maintain  a  list  of  the 
last  detection  points  recorded  in  the  maintain-plume  behavior. 
When  far  from  the  source,  these  points  are  separated  along  the 
axis  of  the  plume.  When  near  the  source,  since  the  source  lo¬ 
cation  is  fixed,  the  “last  detection  points”  list  will  accumulate 
a  set  of  points  near  but  downflow  from  chemical  source  loca¬ 
tion.  This  list  of  last  detection  points  is  monitored,  and  a  suit¬ 
ably  close  clustering  of  the  furthest  upflow  points  generates  the 
source  declaration. 

Generally,  pushing  more  last-detection  points  onto  the  list 
results  in  more  information  about  the  source  location  being 
available  to  the  algorithm.  Increasing  the  number  of  points 
used  in  the  decision  may  increase  the  accuracy  and  relia¬ 
bility,  but  may  also  increase  the  time  required  to  satisfy  the 
declaration  criteria.  The  final  version  of  the  source  location 
estimation  module  used  the  M  =  6  most  recent  points,1 

(^last-1  i  2/last_l)?  (^last_2?  2/last_2)}  •  •  •  ?  (^last-M?  2/lastJVl)*  The 

box  for  estimating  the  source  location  is  determined  by  the 
three  most  upflow  of  these  six  points.  The  sorting  with  respect 
to  flow  direction  uses  the  flow  direction  vector  at  the  time  of  the 
sort.  After  sorting  the  list  of  six  points  in  the  order  of  upflow 
location  (i.e.,  most  upflow  first),  the  AMP  calculated 

^min  —  min{^last_lj  3- last  _2  5  ^last-S} 

3?  max  —  max{:Tiast_l •>  ^-last-2?  ^last-3} 

2/min  —  min{yiast_l  5  2/last  _2  7  2/last  _3  } 

2/max  —  maxjt/last.l  ?  2/last _2  5  2/last _3  }  • 

When  the  diameter  of  the  box  satisfies 

R  —  yj (^max  3?min)^  H“  (2/max  2/min)^  ^  £ 

then  the  source  location  is  estimated  as 

2- source  =  0*5(#min  +  3?  max) 

2/source  —  0*5(2/min  T"  2/max)  • 

fit  is  natural  to  ask  why  the  value  M  =  6  was  selected.  In  the  first  ten  runs, 
we  used  M  =  3  without  successful  source  declaration.  Based  on  analysis  of 
that  mission  data,  we  saw  that  the  last  detection  points  often  alternated  between 
being  near  the  source  and  being  further  downstream.  To  have  three  points  on  the 
list  that  were  near  the  source  therefore  required  M  =  6.  To  have  the  three  most 
upflow  be  first  on  the  list,  the  list  had  to  be  sorted  with  respect  to  flow  direction. 


The  value  for  e  is  affected  mainly  by  the  vehicle  dynamics  and 
the  accuracy  of  the  navigation  system.  The  REMUS  AUV  had  a 
turning  radius  estimated  between  5-10  m  depending  on  vehicle 
speed,  and  the  navigation  systems  was  expected  to  typically  be 
accurate  to  better  than  10  m.  For  our  experiments,  e  was  3-5  m. 

The  declare-source  behavior  includes  a  go-to-goal  module  for 
driving  the  AUV  to  the  source  location  and  then  driving  the 
AUV  home.  The  go-to-goal  module  issues  heading  commands 
0  =  atan2((t/target  -  2/) » (^target  -  x))  that  will  direct  the 
vehicle  from  its  current  location  to  a  target  location.  The  target 
location  is  the  declared  source  location  until  the  AUV  is  within 
10  m  of  that  location.  Then,  the  target  location  is  switched  to  the 
predefined  home  location. 

The  declare-source  activity  is  continually  monitoring  the  list 
of  last-detection  points,  but  its  output  is  inactive  until  the  decla¬ 
ration  condition  is  satisfied.  After  that  time,  since  it  is  the  highest 
priority  behavior,  the  outputs  of  the  declare-source  behavior  de¬ 
termine  the  AUV  trajectory. 

V.  In-Water  Results 

The  AMP  strategy  described  herein  was  tested  in  November 
2002  at  San  Clemente  Island  on  a  REMUS  vehicle.  The 
REMUS  has  been  developed  by  the  Oceanographic  Systems 
Laboratory  at  WHOI.  The  REMUS  vehicle  is  designed  to  be 
small,  lightweight,  and  highly  accurate  in  terms  of  navigational 
performance  and  sensor  data.  The  maximum  operation  depth 
is  100  m,  and  the  velocity  range  is  from  0.25  to  2.8  m/s.  The 
testbed  REMUS  vehicle  contained  two  PC- 104  computers.  The 
first  computer  system  (REMUS)  implemented  the  standard 
REMUS  propulsion,  control,  navigation,  and  sensor  processing 
algorithms.  The  second  computer  system  (AMP)  implemented 
the  CPT  strategy.  The  AMP  sends  guidance  (i.e.,  heading, 
speed,  and  altitude)  commands  to  the  REMUS  via  a  serial  port. 
The  AMP  is  responsible  for  interrupting  the  preprogrammed 
REMUS  mission  (i.e.,  Mission  A  in  Fig.  1),  performing  its 
plume  tracing  task  (i.e.,  Mission  B  in  Fig.  1),  and  then  returning 
the  REMUS  to  its  preprogrammed  mission. 

The  REMUS  vehicle  is  equipped  with  a  variety  of  sensors, 
including  a  fluorometer,  side-scan  sonar,  and  conductivity, 
temperature,  and  depth  sensors.  The  REMUS  also  carries 
sensors  to  provide  information  about  the  current  operating  state 
of  the  vehicle,  including  the  vehicle  latitude  and  longitude, 
depth  and  altitude,  heading  and  speed,  and  water  flow  velocity. 
The  REMUS  implements  control  and  guidance  functions  with 
which  the  AMP  will  interact. 

The  AMP  implements  safety  logic  that  prevents  the  four 
plume-tracing  behaviors  from  driving  the  REMUS  significantly 
outside  of  the  OpArea.  When  one  of  the  behaviors  causes 
REMUS  to  reach  a  boundary,  the  behavior  is  overridden  by  a 
safety  behavior  that  returns  REMUS  to  the  OpArea.  If,  at  any 
time,  the  REMUS  location  is  greater  than  30  m  outside  of  the 
OpArea,  the  AMP  will  relinquish  control,  and  REMUS  will 
resume  the  preprogrammed  task  of  Mission  A. 

The  values  of  the  CPT  algorithm  parameters  that  were  used 
in  the  experiments  are  summarized  in  Table  I.  The  parameters 
were  selected  prior  to  the  in-water  tests  and  not  tuned  during 
the  experiments  unless  specifically  stated  in  the  following.  The 
parameters  in  Table  I  are  based  on  the  results  described  [19] 
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TABLE  I 

Parameters  of  Adaptive  Mission  Planner 


Finding 

Maintaining 

Reacquiring 

Declaring 

Up-flow  search  offset 
d0up=±125  deg 
Down-flow  search  offset 
d9up=±60deg 

Waiting  time 

X  =  8.5  s 

Up-flow  motion  offset 
p(t)  =±10deg 
threshold  =  0.20 

Diameter  of  the  cloverleaf 

dleaf=15™ 

Repetition  number 

N_re  =  3 

Sorted  point  number 

M  =  3  (6) 

Source  estimation  criterion 
e  =  4  m 

TABLE  II 

Environment  Conditions  and  Flow  Information 


Run  ID 

OpArea  defined 

Nominal  Source 

Range  of  Flow  Speed 

Chemical  Release 

in  N-E  frame 

Location  in  Geodetic 

and  Flow  Direction 

Rate 

and  N-E  Frame 

MSN007r2 

Latitude=  32n58.867 

[0.08,  0.12]  (m/s) 

2  gram  /min 

Longitude=l  18w32.248 

[124°,  146°] 

MSN008rl 

The  origin  (center): 

Latitude:  32.00  n58.8435 

Longitude:  118.00w32.2125 

N=  43m 

E  =  -55m 

[0.05,  0.10]  (m/s) 

[129°,  162°] 

2  gram  /min 

MSN008r2 

NW  (  130,  -46)  m. 

SW  (  54,  -129)  m. 

[0.02,  0.07](m/s) 

2  gram  /min 

SE  (-130,  46)  m. 

NE  (-54,  129)  m. 

[122°,  146°] 

MSN009 

rotated  counter  clockwise  47° 

[0.03,  0.09]  (m/s) 

1  gram  /min 

[102°,  173°] 

MSNOlOrl 

The  origin  (center): 

Latitude=  32n58.867 

[0.02,  0.12]  (m/s) 

1  gram  /min 

Latitude  =  32.00  n58. 853. 

Longitude=l  18w32.248 

Longitude=l  1 8.00w32.223 

[298°,  345°] 

MSN010r2 

NW(  148,  -63)  m. 

SW(  72,-146)  m. 

SE  (-148,  63)  m. 

NE  (  -72,  146)  m. 

N  =  26m 

E  =  -38m 

[0.06,  0.07](m/s) 

[321°,  353°] 

1  gram  /min 

MSN010r3 

rotated  counter  clockwise  47 

[0.03,  0.05]  (m/s) 

1  gram  /min 

[358°,  361°] 

and  additional  simulation  studies  that  included  realistic  AUV, 
flow,  and  plume  models.  The  chemical  plume  for  these  tests  was 
Rhodamine  dye.2  The  dye  was  pumped  from  the  source  at  a 
controlled  rate,  as  listed  in  Table  II. 

This  set  of  tests  included  17  vehicle  runs.  We  describe  the 
runs  in  two  batches.  The  first  10  tens  ended  unsuccessfully 
for  various  reasons:  MSN001 — aborted  due  to  an  Op  Area 
data  entry  problem;  MSN001r2 — abort  after  starting  plume 
tracing  due  to  an  incorrect  timeout  setting;  MSN002 — aborted 
due  to  start-up  problems;  MSN003 — traced  and  declared 
but  for  chemical  that  was  not  the  actual  plume  for  this  run; 
MSN004 — CPT  performed  well,  but  source  declaration 
never  occurred;  MSN005 — aborted  due  to  equipment  failure; 
MSN006 — CPT  performed  well,  but  source  declaration  never 
occurred;  MSN007rl — CPT  performed  well  on  chemical  that 
was  not  the  actual  plume  for  this  run.  MSN003  and  MSN007rl 

2Color  images  of  the  source  with  the  plume  and  AUV  are  available  on  the 
first  and  second  authors’  web  sites,  but  are  not  included  herein  as  they  do  not 
render  well  on  black  and  white  printed  media. 


are  anomalous  runs  due  to  dye  previously  in  the  water  flowing 
back  through  the  OpArea.  This  set  of  runs  used  a  list  of  the  most 
recent  M  =  3  points  to  define  the  source  declaration  rectangle 
and  e  =  3  m  in  the  source  declaration  logic.  In  MSN004 
and  MSN006,  CPT  functioned  well,  but  source  declaration 
did  not  occur.  Based  on  analysis  of  the  data  from  MSN004 
and  MSN006,  in  the  source  declaration  logic  we  changed  to 
M  =  6,  e  =  4  m,  and  sorted  the  list  based  on  upflow  location 
as  described  in  Section  IV-D.  Of  these  changes,  increasing  the 
value  of  M  and  sorting  the  list  based  on  upflow  location  were 
the  most  important.  In  the  previous  logic,  using  only  the  three 
most  recent  points  resulted  in  a  source-estimation  rectangle 
that  was  long  in  the  direction  of  the  flow.  The  remainder  of  the 
analysis  in  this  section  will  only  be  concerned  with  the  next 
seven  runs,  which  are  labeled  MSN007r2 — MSN010r3. 

For  the  last  seven  runs,  the  OpArea,  source  location,  flow  con¬ 
ditions,  and  chemical  pump  rate  are  summarized  in  Table  II. 
For  missions  MSN007r2 — MSN009,  the  OpArea  was  defined 
by  a  box  with  comers:  NW  (130,  —46)  m,  SW  (55,  —129)  m, 
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Fig.  9.  Flow  information  for  CPT  mission  MSN007r2.  (a)  Flow  direction  es¬ 
timated  on  the  AUV  in  degrees  for  t  in  [480.3,  1190.6]  during  the  mission 
MSN007r2.  (b)  Flow  speed  estimated  on  the  AUV  in  m/s  for  /  in  [480.3, 1 190.6] 
s  during  the  mission  MSN007r2. 


SE  (—130,  46)  m,  and  NE  (—55,  129)  m.  This  box  is  approx¬ 
imately  254x112  m.  The  long  axis  is  rotated  by  47°  west  of 
north.  For  missions  MSNOlOrl — MSN010r3,  the  Op  Area  was 
defined  by  a  box  with  corners:  NW  (148,  —63)  m,  SW  (72, 
—  146)  m,  SE  (—148,  63)  m,  and  NE  (—72,  146)  m.  This  box  is 
approximately  300 x  112  m.  The  long  axis  is  also  rotated  by  47° 
west  of  north  and  is  approximately  parallel  to  the  shoreline.  The 
fourth  column  of  Table  II  also  lists  the  AMP  range  of  ocean  flow 
speed  and  direction  as  computed  onboard  REMUS  by  AMP.  For 
example,  for  mission  MSN007r2,  the  flow  speed  and  direction 
are  in  the  range  of  [0.08,  0.12]  m/s  and  [124°,  146°],  respec¬ 
tively.  The  temporal  variation  in  the  computed  flow  is  shown  in 
Fig.  9(a)  and  (b). 

Trajectory  and  chemical  detection  data  for  three  runs  are 
shown  in  Figs.  10—12.  In  each  of  these  figures,  the  curve  with 
circles  at  each  end  is  the  vehicle  trajectory.  Each  “x”  along  the 
trajectory  indicates  the  location  of  a  chemical  detection.  The 
rectangle  indicates  the  boundary  of  the  OpArea.  One  circle 
indicates  the  REMUS  position  at  the  start  of  Mission  B.  The 
other  circle  indicates  the  declared  source  location.  Note  that 
the  actual  REMUS  location  is  a  continuous  function  of  time; 
however,  the  computed  REMUS  location  may  change  discon¬ 
tinuous^  as  the  result  of  navigation  corrections  generated  after 
receiving  signal  from  an  in-water  transponder  network.  Such 
navigation  corrections  are  evident  near  the  coordinates  (—75, 
25)  in  Fig.  11  and  (10,  20)  in  Fig.  12.  Numerous  smaller  cor¬ 
rections  also  occur  during  the  runs.  Such  navigation  corrections 
complicate  the  task  of  source  declaration. 
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Fig.  10.  AUV  trajectory  during  plume  tracing  and  source  declaration  for  t  in 
[480.3,  1190.6]  s  during  mission  MSN007r2.  This  time  period  includes  main- 
tain-plume,  reacquire-plume,  and  declare-source  behaviors.  The  thick  x’s  indi¬ 
cate  locations  where  the  chemical  concentration  was  above  threshold  when  the 
vehicle  was  at  that  location. 
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Fig.  11.  CPT  mission  MSN008rl  for  t  in  [60.3,  707.6]  s.  This  time  period 
includes  find-plume,  maintain-plume,  reacquire-plume,  and  declare-source  be¬ 
haviors.  The  thick  x’s  indicate  locations  where  the  chemical  concentration  was 
above  threshold  when  the  vehicle  was  at  that  location. 
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Fig.  12.  CPT  mission  MSN010r2  for  t  in  [80.4,  406.0]  s.  This  time  period 
includes  find-plume,  maintain-plume,  reacquire-plume,  and  declare-source  be¬ 
haviors.  The  thick  x’s  indicate  locations  where  the  chemical  concentration  was 
above  threshold  when  the  vehicle  was  at  that  location. 


For  these  experiments,  the  source  was  affixed  to  the  ocean 
bottom  and  could  not  move.  Therefore,  the  start  of  the  plume, 
as  indicated  by  the  most  upflow  detection  locations,  should 
be  fixed  relative  to  the  bottom.  However,  comparison  of 
Figs.  10-12  shows  that  the  apparent  plume  starting  point  to  be 
different  in  each  of  these  the  runs.  The  difference  for  Figs.  10 
and  11  relative  to  Fig.  12  is  easily  explained,  since  the  OpArea 
definition  was  enlarged  and  shifted  after  MSN009.  The  differ¬ 
ence  between  Figs.  10  and  1 1  is  due  the  setup  of  the  navigation 
system  that  is  affected  by  operational  issues,  ocean  flow,  and  tide 
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TABLE  III 

Declared-Source  Location  and  Time  Cost  for  Operations 


Run  ID 

Start  position 
and 

declared- 
source  location 
in  N-E  frame, 
meters 

Source 
declaration 
error,  meters 

Time  to  find 
plume,  seconds 

V  s 

[W 

TF  /  ^Total 

Time  to  trace 
plume,  seconds 

T  s 

[W 

Tj./  T^tai 

Time  to  declare 
source,  seconds 

Td,  s 
[t2,t3] 

/  ^Total 

Total  time, 
seconds 

^Total '  s 

[t0,t3] 

(-55.5,  82.9) 

AN  =  -14.6 

0 

228.0 

482.3 

710.3 

MSN007r2 

(28.8,  -54.4) 

AE  =  -0.9 

[480.3, 480.3] 

[480.3, 708.3] 

[708.3,  1190.6] 

[480.3, 1190.6] 

0.0% 

32.1% 

67.9% 

(49.7,  -97.8) 

AN  =  -36.6 

67.3 

29.6 

550.4 

647.3 

MSNOO81T 

(  6.8,  -56.2) 

AE  =  0.9 

[60.3,  127.6] 

[127.6,  157.2] 

[157.2,  707.6] 

[60.3, 707.6] 

10.4% 

4.6% 

85.0% 

(51.6,  -99.2) 

AN  =  -29.2 

26.0 

0.0 

273.4 

299.4 

MSN008r2 

(14.2,  -77.6) 

AE  =  22.3 

[60.3,  86.3] 

[86.3,  86.3] 

[86.3, 359.7] 

[60.3, 359.7] 

8.7% 

0.0% 

91.3% 

(-58.0,  33.0) 

AN  =  -32.5 

500.2 

0 

561. 

1061.6 

(  10.9,  -72.3) 

AE  =  -17.7 

[60.4,  560.6] 

[560.6,  560.6] 

[560.6,  1122.0] 

[60.4,  1122.0] 

MSN009 

532.2 

28.7 

209.6 

770.5 

[1122.0,1654.2] 

[1654.2,  1682.9] 

[1682.9,  1892.5] 

[1122.0, 

69.0% 

3.7% 

27.3% 

1892.51 

(-56.6,  57.2) 

AN  =  -15.9 

117.8 

248.9 

169.5 

536.2 

(  10.0,  -85.2) 

AE  =  -47.0 

[80.3,  198.1] 

[198.1,  447.0] 

[447.0,  616.5] 

[80.3,  616.5] 

22% 

46.4% 

31.6% 

MSNOlOrl 

905.4 

0.0 

301.0 

1206.4 

[616.5,  1521.9] 

[1521.9,  1521.9] 

[1521.9,1822.9] 

[616.5, 1822.9] 

75% 

0.0% 

25.0% 

(-60.3,  71.0) 

AN  =  -33.9 

115.2 

50.3 

160.1 

325.6 

MSN010r2 

(  -8.3,  -70.4) 

AE  =  -32.2 

[80.4,  195.6] 

[195.6, 245.9] 

[245.9,  406.0] 

[80.4,  406.0] 

35.4% 

15.5% 

49.2% 

(-59.7,  71.0) 

AN  =  -35.5 

93.1 

15.4 

247.3 

355.8 

MSN010r3 

(  -9.6,  -44.7) 

AE=  -6.5 

[80.3,  173.4] 

[173.4,  188.8] 

[188.8, 436.1] 

[80.3,436.1] 

26.1% 

4.3% 

69.6% 

conditions.  The  (N,  E)  position  is  computed  using  transponders 
in  the  water  column  that  are  tethered  to  the  ocean  floor.  If  the 
transponder  locations  change,  then  the  entire  coordinate  system 
is  shifted  accordingly.  For  example,  when  the  batteries  in  the 
transponders  require  replacement,  the  transponder-tether-an- 
chor  system  is  pulled  up  and  then  reinserted  at  its  nominal 
location.  Reinsertion  involved  divers  getting  a  differential  GPS 
(DGPS)  reading  at  the  surface  near  the  location  at  which  the 
transponder  equipment  was  lowered  approximately  20  m  on  a 
cable.  DGPS  inaccuracy  plus  sway  introduced  by  water  motion 
between  the  boat  on  the  surface  relative  to  the  anchor  at  the 
bottom  of  the  cable  may  introduce  error.  Also,  the  flow  and 
tides  affect  the  position  of  the  transponder  buoys  which  shifts 
the  coordinate  system  relative  to  the  ocean  floor.  Note  that  the 
nominal  source  location  is  computed  via  GPS  and  is  unaffected 
by  flow  conditions.  Therefore,  the  nominal  source  and  declared 
source  location  listed  in  Table  III  should  not  be  used  as  the 
only  methods  of  performance  analysis.  Post-mission  plots  such 
as  those  in  Figs.  10-12  are  further  evidence  that  the  source 
declarations  were  accurate  based  on  the  chemical  detection 
data.  For  Fig.  12,  it  should  be  noted  that  the  REMUS  was  not 
allowed  to  venture  more  than  30  m  outside  the  OpArea  and 
that  detections  outside  the  OpArea  were  ignored  by  the  CPT 
algorithm;  therefore,  the  declared  location  is  based  on  the  most 
upflow  detection  data  available  to  the  AMP.  Finally,  for  this  set 
of  experiments,  a  video  camera  was  in  the  water  and  focused 


on  the  chemical  source.  The  camera  captured  many  images  of 
the  AUV  operating  near  the  source  just  prior  to  its  returning  to 
the  home  location,  which  provides  yet  another  means  to  verify 
tracing  of  the  chemical  plume  to  its  source. 

Table  III  records  data  related  to  start  location,  source  decla¬ 
ration  location,  and  the  time  cost  of  the  vehicle  maneuvers.  All 
stated  locations  are  in  the  (N,  E)  coordinate  frame.  The  second 
column  lists  the  starting  location  on  one  line  with  the  declared 
source  location  underneath.  The  third  column  indicates  the  error 
between  the  declared  source  location  and  the  nominal  source  lo¬ 
cation.  Among  the  various  runs,  the  vehicle  starting  location  was 
varied,  with  the  objective  of  forcing  different  experimental  con¬ 
ditions.  For  example,  as  shown  in  Fig.  11,  the  start  position  for 
MSN008rl  was  located  at  (49,  —97)  m,  and  the  vehicle  started 
by  using  the  down-flow  plume-finding  behavior.  As  shown  in 
Fig.  12,  the  start  position  for  MSN010r2  was  located  at  (—60, 
71)  m,  but  the  flow  direction  was  now  to  the  northwest;  there¬ 
fore,  the  vehicle  started  at  the  opposite  end  of  the  search  area, 
but  again  used  the  downflow  plume-finding  behavior.  Note  that 
it  required  several  seconds  for  the  AUV  to  change  from  its  initial 
upflow  heading  to  the  commanded  downflow  search  direction. 
In  each  of  these  last  seven  runs,  the  find-plume,  maintain-plume, 
and  reacquire-plume  behaviors  were  impressive,  and,  in  each 
case,  the  source  declaration  logic  succeeded. 

The  accuracies  of  the  declared  locations  relative  to  the  nom¬ 
inal  source  locations,  as  recorded  in  Table  III,  are  on  the  order 
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TABLE  IV 

Travel  Distance  for  Plume  Tracing  (Source-Found)  and  Source-Declared 


Run  ID 

DQ,m 

Dj,m 

D2  ,  m 

°3’m 

D,/D0 

Di/D3 

Source 

declaration 

MSN007r2 

164.2 

411.0 

864.7 

1275.7 

2.50 

32.2% 

Yes 

MSN008H 

36.7 

60.9 

1013.1 

1074.0 

1.66 

5.7% 

Yes 

MSN008r2 

9.7 

0.0 

499.9 

499.9 

0.0 

0.0% 

Yes 

4.1 

0.0 

984.2 

984.2 

0.0 

0.0% 

No 

MSN009 

47.0 

55.8 

371.1 

426.9 

1.19 

13.1% 

Yes 

112.3 

437.4 

335.8 

713.2 

3.89 

56.6% 

No 

MSNOlOrl 

9.2 

0.0 

568.5 

568.5 

0.0 

0.0% 

Yes 

MSN010r2 

84.2 

96.2 

293.0 

389.2 

1.14 

24.7% 

Yes 

MSN010r3 

18.8 

25.3 

435.6 

460.9 

1.35 

5.5% 

Yes 

of  tens  of  meters.  Given  that  the  vehicle  navigation  system  ac¬ 
curacy  is  also  approximately  10  m  and  that  the  area  covered  by 
this  level  of  uncertainty  is  small  relative  to  the  size  of  the  search 
area,  this  level  of  performance  was  quite  satisfactory.  Even  so, 
these  accuracies  must  be  interpreted  with  caution.  In  addition 
to  the  possible  errors  between  the  coordinate  systems  of  the 
nominal  source  and  the  declared  source  locations,  the  following 
factor  could  affect  the  accuracy  of  the  reported  locations.  Due 
to  the  fact  that  the  chemical  source  is  on  the  bottom  and  the  ve¬ 
hicle  is  driving  at  a  nonzero  altitude,  the  chemical  will  not  be 
detected  in  the  immediate  vicinity  of  the  source.  The  chemical 
will  only  be  detected  at  a  distance  in  the  downflow  direction 
that  is  sufficient  for  the  chemical  plume  to  rise  to  the  altitude 
of  the  vehicle.  Therefore,  the  declared  source  location  is  known 
to  be  some  distance  downflow  from  the  source.  This  downflow 
direction  is  known,  but  the  distance  is  not  known  since  the  dis¬ 
tance  depends  on  environmental  factors.  Therefore,  the  likely 
source  location  is  within  a  long  narrow  rectangle.  The  long  edge 
is  parallel  to  the  flow.  The  downflow  narrow  edge  is  centered  on 
the  declared  source  location.  Calibration  of  the  errors  between 
the  transponder  relative  declared  source  location  and  earth  fixed 
nominal  source  location  will  be  a  major  issue  addressed  prior  to 
subsequent  in-water  testing. 

To  analyze  the  efficiency  of  the  CPT  strategy,  we  define  the 
following  times:  to  is  the  time  at  which  Mission  B  starts,  t±  is 
the  first  time  that  chemical  is  detected,  1 2  is  the  first  time  that  the 
plume  is  traced  to  within  13  m  of  the  declared  source  location 
for  that  run,  and  £3  is  the  time  at  which  the  source  location  is 
declared.  Note  that  the  time  £2  is  n°t  known  during  the  mission 
and  can  only  be  computed  via  post-processing.  The  time  spent 
searching  for  the  plume  is  Tp  =  £1  —  to-  The  time  spent  tracking 
the  plume  from  the  first  detection  point  to  a  point  within  13  m  of 


the  declared  location  is  Tt  —  £2  —  £1  •  Time  £2  will  be  referred 
to  as  the  time  at  which  the  source  was  found — even  though  the 
AMP  did  not  actually  declare  until  time  £3.  After  first  approach 
within  13  m  of  the  declared  source,  the  time  spent  maneuvering 
prior  to  declaring  the  source  location  is  Tp  =  £3  —  £2-  The 
total  CPT  mission  time  is  Txotai  =  Tp  +  Tt  +  Tp.  Columns 
4-7  of  Table  III  provide  this  data  as  well  as  the  corresponding 
percentage  times  for  each  of  the  last  seven  AMP  test  runs.  Usu¬ 
ally,  the  REMUS  vehicle  follows  the  search  cycle:  plume-found, 
source-found,  and  source-declared.  Except  for  MSN007r2,  each 
run  started  with  the  AMP  algorithm  using  the  find-plume  be¬ 
havior.  During  MSN009  and  MSNOlOrl,  the  vehicle  activated 
the  find-plume  behavior  twice,  because  in  the  first  search  cycle 
the  REMUS  failed  to  declare  the  source  location  even  though  it 
found  the  source  location.  For  those  two  runs,  two  values  of  £]_, 
£2,  and  £3  are  presented.  The  first  value  of  £3  is  the  time  at  which 
the  AMP  switched  back  to  the  find-plume  behavior  due  to  the 
failure  in  the  source  declaration. 

The  longest  time  to  find  the  plume  was  905.4  s  in  the  second 
search  circle  of  MSNOlOrl.  During  the  source-finding  period 
[£1  ?  £2] »  the  maintain-plume  and  require-plume  alternatively 
activate  to  steer  the  REMUS  toward  to  the  odor  source  loca¬ 
tion.  The  longest  time  interval  to  find  the  source  is  228.0  s 
in  MSN007r2,  but  its  time  cost  just  was  32.1%  of  the  total 
time  cost  for  that  test  run.  During  the  source-declared  period 
[£25^3]*  the  maintain-plume  and  reacquire-plume  behaviors 
kept  the  REMUS  near  the  odor  source  location.  The  test  data 
show  that,  in  each  case,  the  revised  declare-source  algorithm 
declared  the  odor  source  location  correctly;  however,  typically, 
the  source  declaration  time  Tp  was  significantly  more  than 
three  times  the  tracking  time  Tt-  The  longest  time  interval  for 
the  source-declared  maneuver  is  550.4  s  during  MSN008rl. 
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The  largest  source-declared  percentage  was  91.3%  in  the  test 
run  MSN008r2. 

Table  IV  presents  data  to  allow  analysis  of  the  search  effi¬ 
ciency  in  terms  of  distance  traveled.  Do  is  the  Euclidean  dis¬ 
tance  between  the  position  at  which  chemical  is  first  detected  at 
time  1 1  and  the  source  location  declared  at  £3 


Do  =  \J  ( xt3  -  xtlf  +  (y*3  -  ytl)2. 

Do  may  be  defined  as  the  ideal  minimum  path  for  plume  tracing. 
Do  is  not  expected  to  be  achievable  due  to  maneuverability  is¬ 
sues  and  meander  and  intermittency  of  the  real  plume;  however, 
it  provides  a  useful  benchmark.  Di  is  the  actual  travel  distance 
during  the  time  interval  [£i,£2],  which  is  computed  as 

di  =  '}2V (*/+:  -  xt)2  +  (yt+i  -  yt)2,  t<E[tut2]. 

D\  is  the  distance  traveled  to  track  the  plume  to  within  13  m  of 
the  declared  source  location  for  the  first  time.  D2  is  the  distance 
traveled  during  the  time  interval  [£2,  £3],  which  is  computed  as 

D2  =  ^2  \j C xt+i  -  xt)2  +  (yt+ 1  -  yt)2,  t  e  [£2, £3]- 

D2  represents  the  distance  traveled  between  the  time  the 
REMUS  first  gets  within  13  m  of  the  declared  source  and 
the  time  that  the  source  is  declared.  Finally,  the  total  distance 
traveled  is  D3  =  Di  +  D2. 

Except  in  MSN008r2  and  the  first  search  cycle  of  MSN009, 
the  actual  travel  distance  for  plume  tracing  D±  is  larger  than 
the  ideal  plume  length  Do-  The  largest  ratio  of  Di  to  Do  is 
3.9  in  the  first  search  cycle  of  MSNOlOrl.  The  average  ratio  of 
Di  to  Do  is  1.3,  which  is  considered  quite  good  as  the  average 
amount  that  D 1  could  be  decreased  is  only  23%.  The  biggest 
Do  is  164.2  m  in  MSN007r2  where  D\  is  411.0  m.  We  do  not 
include  the  ratio  of  D2  to  the  other  distances,  because  D2  is  not 
expected  to  scale  with  the  length  of  the  plume.  From  the  data,  it 
is  clear  that  the  majority  of  each  mission  was  spent  in  the  process 
of  making  the  source  declaration.  This  allows  significant  room 
for  improvement;  however,  care  must  be  taken  to  ensure  that 
improved  speed  of  declaration  does  not  sacrifice  the  reliability 
of  the  declaration  in  the  sense  that  this  algorithm  made  no  false 
declarations. 

VI.  Conclusion 

This  paper  has  presented  an  AMP  strategy  for  finding  and 
tracing  a  chemical  plume  and  declaring  a  source  location  using 
a  subsumption  architecture.  The  strategy  was  implemented  on 
a  REMUS  vehicle  and  tested  in  near-shore  ocean  conditions. 
For  these  experiments,  the  OpArea  was  250-300  m  along-shore 
and  100  m  cross-shore.  Plumes  were  tracked  for  over  100  m.  At 
the  time  of  these  experiments,  this  AMP  strategy  was  the  first 
reported  instance  of  chemical  plume  tracing  in  a  “real-world” 
environment,  the  search  area  was  the  largest  in  which  chem¬ 
ical  plume  tracing  experiments  were  attempted,  the  experiments 


were  the  first  to  successfully  and  reliably  declare  a  source  loca¬ 
tion,  and  the  results  demonstrated  the  longest  instances  of  chem¬ 
ical  plume  tracking. 

The  source  declaration  accuracy  can  only  be  characterized  as 
accurate  to  tens  of  meters,  due  to  issues  related  to  the  nominal 
source  location  being  in  a  distinct  coordinate  system  and  param¬ 
eters  for  the  proper  transformation  between  the  coordinate  sys¬ 
tems  being  unknown  and  time  varying.  This  issue  has  motivated 
two  changes  to  be  implemented  prior  to  future  in- water  testing. 
First,  after  source  declaration,  the  AMP  will  implement  a  fly-by 
maneuver  to  drive  the  AUV  past  the  declared  source  location  in 
the  downflow  direction.  Since  there  is  a  camera  focused  on  the 
source,  this  maneuver  will  allow  visual  confirmation  of  correct 
declared  source  locations.  Second,  after  source  declaration,  the 
AMP  will  implement  a  maneuver  to  acquire  sidescan  sonar  data 
in  the  vicinity  of  the  declared  location.  Since  sidescan  data  are 
calibrated  within  the  same  coordinate  system  as  the  source  dec¬ 
laration,  this  approach  will  allow  absolute  comparisons  between 
the  declared  and  actual  source  locations. 

The  purpose  of  the  in- water  experiments  was  demonstration 
and  evaluation  of  the  CPT  approach  and  acquisition  of  chemical 
distribution  data  along  a  plume  in  a  near  shore  ocean  envi¬ 
ronment.  Evaluation  of  alternative  algorithms  or  of  algorithm 
performance  as  a  function  of  algorithm  parameters  would  have 
been  interesting,  but  was  precluded  by  the  time  and  cost  of 
running  the  in- water  tests.  However,  we  have  analyzed  the 
efficiency  of  the  present  algorithm.  The  find-plume,  main- 
tain-plume,  and  reacquire-plume  behaviors  were  robust  and 
worked  well.  By  robust,  we  mean  that  the  algorithms  succeeded 
many  times  under  different  experimental  conditions  without 
any  changes  to  the  parameters  of  the  algorithms.  On  the  other 
hand,  while  the  present  source  declaration  approach  was  suc¬ 
cessful  in  the  sense  that  it  never  made  an  invalid  declaration, 
due  to  the  difficulty  of  the  source  declaration  problem  based 
on  olfaction  alone,  the  time  and  distance  travel  to  make  the 
declarations  leaves  significant  room  for  improvement  in  the 
future. 

Finally,  a  last  important  lesson  learned  in  this  experiment  is 
that  the  altitude  control  algorithm  achieves  an  altitude  above  the 
commanded  altitude  when  the  water  depth  is  increasing  (off¬ 
shore  direction)  and  an  altitude  below  the  commanded  altitude 
when  the  water  depth  is  decreasing  (onshore  direction).  There¬ 
fore,  because  the  REMUS  was  at  a  lower  altitude  when  driving 
toward  from  shore  and  because  the  plume  is  near  the  bottom, 
the  REMUS  was  more  likely  to  detect  chemical  when  driving 
toward  shore. 
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